Terminal apparatus, display method and recording medium

ABSTRACT

An information processing apparatus that controls a display disposed on a casing of the information processing apparatus to display an image; outputs, by a communication interface of the information processing apparatus, the image displayed on the display; detects an orientation of the casing; and generates different images as the image displayed on the display and the image output by the communication interface when a predetermined change of orientation of the casing is detected.

CROSS REFERENCE TO RELATED APPLICATION

The present continuation application claims the benefit of priorityunder 35 U.S.C. 120 to application Ser. No. 13/892,918, filed on May 13,2013, which claims the benefit of U.S. Provisional Patent ApplicationSer. No. 61/652,526 filed on May 29, 2012, the entire contents of bothof which are incorporated herein by reference.

BACKGROUND

Field of the Disclosure

The present disclosure relates to a terminal apparatus including adisplay section, a display method applied to the terminal apparatus, anda recording medium.

Description of Related Art

In recent years, mobile telephone terminal apparatuses having enhancedfunctionality, which are called smart phones, have been widespread. Asmart phone is provided with a relatively high-resolution display panel,and is capable of displaying a moving image and a still image. Forexample, it is possible to display an image captured using a camerafunction included in a smart phone on a display panel with highresolution. Alternatively, a smart phone accesses the Internet so as toallow the display panel to display images obtained from varioushomepages.

Also, some smart phones are provided with a video output terminal. Thevideo output terminals disposed on a smart phone include an interfaceterminal for an HDMI (High-Definition Multimedia Interface) standard,for example. An HDMI-standard terminal is a terminal for outputtinghigh-resolution video data, for example, in which the number of pixelsof one screen is 1920 pixels in the horizontal direction×1080 pixels inthe vertical direction.

Such an HDMI-standard video output terminal of a smart phone isconnected to a video input terminal of a display unit, such as atelevision receiver, a computer display, etc., using an HDMI-standardtransmission cable so that the display unit is allowed to display a sameimage as an image that is being displayed on the display panel of thesmart phone itself.

SUMMARY

Incidentally, a display panel included in a smart phone has a screenhaving a length of a diagonal of about 10 centimeters, for example, andis small in size. On the other hand, a display unit, such as atelevision receiver, a computer display, etc., includes a relativelylarge-sized display panel.

Accordingly, when an image that is suitable for a smart phone to displayis displayed on a display unit including a large-sized display panelwithout change, an unsuitable image is sometimes displayed.

For example, at the time of accessing the Internet using a smart phonein order to display a specific homepage, a screen for a mobile terminalis sometimes displayed. This screen for a mobile terminal is a screen inwhich characters and images become suitable display sizes when thescreen is displayed on a display panel having a length of a screendiagonal of about 10 centimeters, for example. When this mobile terminalscreen is displayed on a large-sized display unit without change,characters and images to be displayed on the display unit are too large,and it is difficult to say that it is a suitable display.

Also, there is a problem in that if the large-sized display unitdisplays a mobile terminal screen without change in this manner, adisplay performance of the large-sized display panel possessed by thedisplay unit is not taken advantage of. That is to say, a large-sizeddisplay unit is normally allowed to display a high-resolution image inaccordance with a size of a display panel. However, there is a problemin that if a mobile terminal screen is displayed without change, such aperformance of the display unit is not utilized.

On the other hand, if a normal homepage screen to be displayed on acomputer display, etc., is displayed on a display panel of a smartphone, character sizes in images to be displayed on a display panel aretoo small, and thus it is difficult to say that it is a suitabledisplay.

Also, if a normal homepage screen is displayed on a display panel of asmart phone, GUI (Graphical User Interface) buttons on the screen becomevery small representations, and thus button operations on a touch panelsometimes become difficult.

Also, in addition to display sizes and operationality, if a same screenis displayed on a mobile telephone terminal apparatus, such as a smartphone, etc., and on a television receiver or a computer display, one ofthe display screens is sometimes not suitable.

In the case of connecting a terminal apparatus and a display unit, anddisplaying same information, the inventors recognize necessity ofsuitably adjusting individual displays in accordance with displayperformances of the individual apparatuses and states of theapparatuses. Also, the inventors recognize necessity of providing newoperationality by connecting a terminal apparatus and a display unit.

According to an embodiment of the present disclosure, there is providedan information processing apparatus that controls a display disposed ona casing of the information processing apparatus to display an image;outputs, by a communication interface of the information processingapparatus, the image displayed on the display; detects an orientation ofthe casing; and generates different images as the image displayed on thedisplay and the image output by the communication interface when apredetermined change of orientation of the casing is detected.

By the present disclosure, when the motion sensor detects a change inthe direction of the casing, by taking this opportunity, it is possibleto cause the image displayed on the display panel of the terminalapparatus and the image externally outputted by the image output sectionto have different images, thereby the individual images can be suitablyproduced.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating an example of configurations of aterminal apparatus and a display unit according to a first embodiment ofthe present disclosure.

FIG. 2 is a configuration diagram illustrating an example of an outershape of the terminal apparatus according to the first embodiment of thepresent disclosure.

FIGS. 3A and 3B are explanatory diagrams illustrating a connection stateand a display example according to the first embodiment of the presentdisclosure.

FIG. 4 is an explanatory diagram illustrating a wireless connectionstate and a display example according to the first embodiment of thepresent disclosure.

FIG. 5 is a flowchart illustrating an example of display processingaccording to the first embodiment of the present disclosure.

FIGS. 6A and 6B are explanatory diagrams illustrating an example of adisplay change by a direction of the terminal apparatus according to thefirst embodiment of the present disclosure,

FIG. 7 is a flowchart illustrating an example of display processingaccording to a second embodiment of the present disclosure.

FIGS. 8A and 8B are explanatory diagrams illustrating an example of adisplay change by a direction of the terminal apparatus according to thesecond embodiment of the present disclosure.

FIGS. 9A and 9B are explanatory diagrams illustrating a display exampleof a control screen of the terminal apparatus according to the secondembodiment of the present disclosure.

FIG. 10 is a flowchart illustrating an example of selecting a controlscreen of the terminal apparatus according to the second embodiment ofthe present disclosure.

FIGS. 11A-11C are explanatory diagrams illustrating another example of acontrol screen of the terminal apparatus according to the secondembodiment of the present disclosure.

FIG. 12 is an explanatory diagram illustrating still another example ofa control screen of the terminal apparatus according to the secondembodiment of the present disclosure.

FIGS. 13A and 13B are explanatory diagrams illustrating an example of akeyboard screen of the terminal apparatus according to the secondembodiment of the present disclosure.

DETAILED DESCRIPTION

In the following, a description will be given of a terminal apparatusaccording to an embodiment of the present disclosure, an example of adisplay method, and a recording medium with reference to the drawings inthe following order.

1. First embodiment

1-1. Configuration of terminal apparatus (FIG. 1, FIG. 2)

1-2. Display processing in normal mode (FIG. 3, FIG. 4)

1-3. Display processing when terminal apparatus has moved (FIG. 5, FIG.6)

2. Second embodiment

2-1. Display processing when terminal apparatus has moved (FIG. 7, FIG.8)

2-2. Another example of control screen (FIG. 9 to FIG. 12)

2-3. Example of keyboard screen (FIG. 13)

3. Variations

1. First Embodiment

[1-1. Configuration of Terminal Apparatus]

FIG. 1 is a diagram illustrating configurations of a mobile telephoneterminal apparatus 100 and a display unit 200.

The mobile telephone terminal apparatus 100 is a terminal apparatushaving enhanced functionality, for example, which is called a smartphone. The display unit 200 is, for example, a television receiver.

The mobile telephone terminal apparatus 100 includes an antenna 101 forperforming wireless communication with a wireless-telephone basestation. The antenna 101 is connected to a wireless communicationprocessing section 102. The wireless communication processing section102 performs transmission and reception processing of radio signalsunder the control of a control section 110. The control section 110transmits a control command to a wireless communication processingsection 102 through a control line CL. The control section 110 reads aprogram (software) stored in a memory 150 through the control line CL,and executes the program so as to control each section of the mobiletelephone terminal apparatus 100. The memory 150 included in the mobiletelephone terminal apparatus 100 stores data provided in advance, suchas a program, etc., and stores data generated by a user's operation. Thememory 150 stores and reads the data under the control of the controlsection 110.

At the time of voice communication, telephone audio data received by thewireless communication processing section 102 is supplied to a audioprocessing section 103 through a data line DL. The audio processingsection 103 performs demodulation processing of the supplied audio data,and obtains an analog audio signal. The analog audio signal obtained bythe audio processing section 103 is supplied to a speaker 104, and soundis output from the speaker 104. Also, at the time of voicecommunication, the audio processing section 103 converts an audio signaloutputted from the microphone 105 into audio data in a transmissionformat. And the audio data converted by the audio processing section 103is supplied to the wireless communication processing section 102 throughthe data line DL. Also, the audio data supplied to the wirelesscommunication processing section 102 is packetized, and isradio-transmitted.

In the case of performing data communication, and email transmission andreception through a network, such as the Internet, etc., the wirelesscommunication processing section 102 performs transmission and receptionprocessing under the control of the control section 110. For example,data received by the wireless communication processing section 102 isstored in the memory 150, and processing, such as display based on thestorage data, etc., is performed under the control of the controlsection 110. Also, the data stored in the memory 150 is supplied to thewireless communication processing section 102, and is radio-transmitted.If it is necessary to discard a received email, the control section 110deletes the data stored in the memory 150.

The mobile telephone terminal apparatus 100 includes a displayprocessing section 120. The display processing section 120 displaysimages and various kinds of information on a display panel 121 under thecontrol of the control section 110. For the display panel, for example,a liquid-crystal display panel or an organic EL (Electro-Luminescence)display panel is used.

Also, the mobile telephone terminal apparatus 100 includes a touch panelsection 130, and when an object, such as a finger or a pen, etc.,touches a surface of the display panel 121, the touch panel section 130detects a touch position. For the touch panel section 130, for example,a capacitive touch panel is used.

Data of the touch position detected by the touch panel section 130 istransmitted to the control section 110. The control section 110 performsan application, which has been started, on the basis of the suppliedtouch position.

Also, the mobile telephone terminal apparatus 100 includes operationkeys 140. Operation information on the operation keys 140 is transmittedto the control section 110. In this regard, a major portion of operationon the mobile telephone terminal apparatus 100 is performed by touchpanel operation using the touch panel section 130, and the operationkeys 140 is used for only a part of the operation.

Also, the mobile telephone terminal apparatus 100 includes a short-rangewireless communication processing section 107 to which an antenna 106 isconnected. The short-range wireless communication processing section 107performs short-range wireless communication with a neighboring terminalapparatus and an access point. The short-range wireless communicationprocessing section 107 performs wireless communication with the otherparty, for example, in a range of about tens of meters by applying, forexample, wireless LAN (Local Area Network) system, which is defined asan IEEE 802.11 system.

The mobile telephone terminal apparatus 100 according to the presentdisclosure can transmit an image being displayed on the display panel121 by the display processing section 120 to an external display unitthrough wireless communication using the short-range wirelesscommunication processing section 107. However, as described later, animage transmitted by the short-range wireless communication processingsection 107 is sometimes an image in a different display form from theimage being displayed on the display panel 121.

Further, the mobile telephone terminal apparatus 100 includes a motionsensor section 108. The motion sensor section 108 includes a sensor thatdetects motion or a direction of the apparatus, for example, anacceleration sensor, an angular velocity sensor, a geomagnetic sensor,etc. The acceleration sensor detects accelerations in three directions,for example, longitudinal, lateral, and altitudinal directions. Datadetected by this motion sensor section 108 is supplied to the controlsection 110, The control section 110 determines a state of the mobiletelephone terminal apparatus 100 on the basis of the data supplied fromthe motion sensor section 108. For example, on the basis of the datasupplied from the motion sensor section 108, the control section 110determines whether the casing constituting the mobile telephone terminalapparatus 100 is in a longitudinal direction, or a lateral direction.

Also, the mobile telephone terminal apparatus 100 includes aninput/output processing section 160. A terminal section 170 is connectedto the input/output processing section 160, and the input/outputprocessing section 160 performs input processing and output processingof data from and to the outside through a transmission cable 300connected to the terminal section 170. The terminal section 170 is, forexample, an output terminal for an interface of an HDMI (High-DefinitionMultimedia Interface) standard. The terminal section 170, which is anoutput terminal for the HDMI standard interface, is a terminal foroutputting high-resolution video data, for example, in which the numberof pixels per one screen is 1920 pixels in the horizontal direction×1080pixels in the vertical direction, and audio data accompanying the videodata, to the connected transmission cable. The number of pixels of thevideo data is one example. The transmission cable 300 also complies withthe HDMI standard.

The mobile telephone terminal apparatus 100 according to the presentdisclosure can transmit an image being displayed on the display panel121 by the display processing section 120 to an external display unitthrough the transmission cable connected to the terminal section 170.However, as described later, an image outputted from the terminalsection 170 is sometimes different from an image being displayed on thedisplay panel 121. When an image being displayed on the display panel121 and an image that is outputted from the terminal section 170 aredifferent, the display processing section 120 performs processing forcreating individual video data.

In this regard, the interface of the HDMI standard can bidirectionallytransmit data other than video data, such as control data, dataindicating a device state, etc. For example, as described later, whenthe mobile telephone terminal apparatus 100 and the display unit 200 areconnected by a transmission cable, the mobile telephone terminalapparatus 100, which is a video output device, obtains data indicating adisplay ability of the display unit 200 (a display sire, a number ofdisplay pixels, a frame frequency, etc.), which is a video input device.And the terminal section 170 of the mobile telephone terminal apparatus100 outputs video data in a format conforming to the obtained displayability.

Next, a description will be given of a configuration of the display unit200 illustrated in FIG. 1.

The display unit 200 is formed, for example, as a television receiver.The display unit 200 includes a terminal section 201, The terminalsection 201 is assumed to be, for example, an input terminal of anHDMI-standard interface. Video data obtained by the terminal section 201is supplied to a switching section 202. The switching section 202selects any one of video data outputted from the terminal section 201,video data outputted from a tuner 204, and video data outputted from ashort-range wireless communication processing section 206. The selectionby the switching section 202 is performed under the control of thecontrol section 203. The tuner 204 is a tuner that receives a broadcastwave of television broadcasting, etc., and obtains video data.

The short-range wireless communication processing section 206 performsshort-range wireless communication with a neighboring terminal apparatusand an access point. In order to perform this short-range wirelesscommunication, an antenna 205 is connected to the short-range wirelesscommunication processing section 206. The short-range wirelesscommunication processing section 206 performs communication by a samewireless communication system (for example, a wireless LAN system) asthat of the short-range wireless communication processing section 107 ofthe mobile telephone terminal apparatus 100.

And video data selected by the switching section 202 is supplied to thedisplay section 210. The display section 210 includes a large-sizeddisplay panel 211 as compared with the display panel 121, and performsdisplay processing of an image on the display panel 211 on the basis ofthe supplied video data. In this regard, at the time of explainingoperation described later, the switching section 202 of the display unit200 is in a state of selecting an image inputted into the terminalsection 201 (or an image received by the short-range wirelesscommunication processing section 107).

FIG. 2 is a diagram illustrating an example of a shape of the mobiletelephone terminal apparatus 100.

The mobile telephone terminal apparatus 100 formed as a smart phone hasa longitudinally long casing having a surface on which the display panel121 is disposed. A diagonal length of the display panel 121 is, forexample, about 10 centimeters. Display on the display panel 121 isdriven by the display processing section 120, Also, a touch on thesurface of the display panel 121 by a finger, etc., is detected by thetouch panel section 130.

As illustrated in FIG. 2, when the casing is disposed in alongitudinally-long manner, the display panel 121 haslongitudinally-long screen disposition with a long side having alongitudinal length L1, and a short side having a lateral length L2. Theratio of the length L1 to the length L2 is, for example, 16:9. In thefollowing explanation, a side of the length L1 is called a long side,and a side of the length L2 is called a short side.

Also, on the mobile telephone terminal apparatus 100, a plurality ofoperation keys 140 are disposed on the lower part of the surface of thelongitudinally-long casing of the display panel 121. In the example inFIG. 2, three operation keys 140 are provided.

Further, on the mobile telephone terminal apparatus 100, a terminalsection 170, which is an output terminal for an HDMI-standard interface,is disposed at an upper end part. This terminal section 170 has aterminal cover, and the terminal cover is removed at the time ofconnecting a cable.

[1-2. Display Processing in Normal Mode]

Next, a description will be given of a display example in a normal modeat the time of connecting the mobile telephone terminal apparatus 100according to the present disclosure and the display unit 200.

As described before, the mobile telephone terminal apparatus 100 isprovided with the terminal section 170, which is an output terminal foran HDMI-standard interface. Also, the display unit 200 is provided withthe terminal section 201, which is an input terminal for anHDMI-standard interface. As illustrated in FIG. 3, these terminalsections 170 and 201 are connected with the transmission cable 300.

FIG. 3A is an unconnected state of the mobile telephone terminalapparatus 100 and the display unit 200 by the transmission cable 300,and FIG. 3B is a connected state of the mobile telephone terminalapparatus 100 and the display unit 200 by the transmission cable 300.

That is to say, as illustrated in FIG. 3B, one plug 301 of thetransmission cable 300 is connected to the terminal section 201 of thedisplay unit 200, and the other plug 302 is connected to the terminalsection 170 of the mobile telephone terminal apparatus 100 so that videodata is transmitted. In the state of FIG. 3A, the plug 302 of thetransmission cable 300 is unconnected to the terminal section 170 of themobile telephone terminal apparatus 100, and thus connection is notcompleted.

In the unconnected state as illustrated in FIG. 3A, an image displayedon the display panel 121 of the mobile telephone terminal apparatus 100is not transmitted to the display unit 200. FIG. 3A illustrates anexample in which an image at the time when the mobile telephone terminalapparatus 100 has accessed a predetermined Web server is displayed onthe display panel 121.

On the display screen of FIG. 3A, a status bar 801 is displayed on anupper end, and a search-character input place 802 and a news displayplace 803, etc., are displayed as images obtained from the Web server.

The status bar 801 is for displaying information indicating a state ofthe mobile telephone terminal apparatus 100. Specifically, on the statusbar 801, a mark indicating a reception state by the wirelesscommunication processing section 102 of a radio wave from a basestation, a mark indicating a remaining amount of a battery driving themobile telephone terminal apparatus 100, time obtained by a clockfunction included in the mobile telephone terminal apparatus 100, etc.,are displayed.

The search-character input place 802 is a place where a user operatesthe mobile telephone terminal apparatus 100 to input characters by whicha Web server makes a search. At the time of inputting the characters,for example, a keyboard is displayed on the display panel 121. A displayexample of the keyboard will be described later.

In this regard, the display illustrated in FIG. 3A is an example, and adisplay other than the status bar 801 changes depending on an operationstate of the mobile telephone terminal apparatus 100. For example, whenthe mobile telephone terminal apparatus 100 plays back a moving imagecontent, such as a movie, etc., the played-back image is displayed onthe display panel 121. In the case of displaying such a moving imagecontent, as long as an operation mode of not displaying the status bar801, the display panel 121 displays the status bar 801 all the time.

In a state in which the display panel 121 is performing such a displayas illustrated in FIG. 3A, the mobile telephone terminal apparatus 100is connected with the display unit 200 by the transmission cable 300 asillustrated in FIG. 3B, the display panel 211 of the display unit 200performs the same display as the display panel 121. That is to say, asillustrated in FIG. 3B, the status bar 801, the search-character inputplace 802, and the news display place 803, etc., which are displayed onthe display panel 121 of the mobile telephone terminal apparatus 100,are displayed on the display panel 211 of the display unit 200 withoutchange. For example, when the display panel 211 of the display unit 200is as large as having a diagonal length of about 100 centimeters, andthe display panel 121 of the mobile telephone terminal apparatus 100 hasa diagonal length of about 10 centimeters, the image is displayed bybeing enlarged about 10 times. In the example in FIG. 3B, the example,in which the display panel 211 of the display unit 200 displays anenlarged status bar 901, an enlarged search-character input place 902,and an enlarged news display place 903 are displayed, is illustrated.

In this manner, the mobile telephone terminal apparatus 100 and thedisplay unit 200 perform the same display at the time of being connectedby the transmission cable 300 when the operation mode of the mobiletelephone terminal apparatus 100 is in a normal mode.

Also, in the mobile telephone terminal apparatus 100, if the displayunit 200 is in an unconnected state, a longitudinal direction and alateral direction are set for a display on the display panel 121 inaccordance with a direction of the casing detected by the motion sensorsection 108. For example, as illustrated in FIG. 2, in alongitudinally-long state in which the long side L1 of the display panel121 is disposed substantially in the vertical direction, the displaypanel 121 performs a longitudinally-long image display with the longside L1 being in the vertical direction and the short side L2 being inthe horizontal direction. Also, as illustrated in FIG. 3A, in alaterally-long state in which the long side L1 of the display panel 121is disposed substantially in the horizontal direction, the display panel121 performs a laterally-long image display with the short side L2 beingin the vertical direction, and the long side L1 being in the horizontaldirection. Processing for generating a display image in accordance withthe direction is, for example, performed by the display processingsection 120.

And in the case of a state in which the mobile telephone terminalapparatus 100 is connected to the display unit 200, whichever directionof the casing is detected by the motion sensor section 108, the displaypanel 121 performs a laterally-long image display with the short side L2being in the vertical direction and the long side L1 being in thehorizontal direction at the time of connection. The reason why thedirections is set in this manner is that the display panel 121 matchesthe disposition state of the display panel 211 of the display unit 200.

In FIG. 3, a description has been given of the example in which aconnection is made by a wired transmission cable 300, but it is possibleto connect the mobile telephone terminal apparatus 100 and the displayunit 200 by a wireless transmission path (wireless), and to transmitvideo data from the mobile telephone terminal apparatus 100 to thedisplay unit 200 in the same manner.

FIG. 4 is an example in which a connection is made with a wirelesstransmission path. That is to say, the short-range wirelesscommunication processing section 107 of the mobile telephone terminalapparatus 100 and the short-range wireless communication processingsection 206 of the display unit 200 performs wireless communicationusing a wireless LAN system, etc., so that it is possible to transmitvideo data from the mobile telephone terminal apparatus 100 to thedisplay unit 200.

At the time of wireless transmission like this, in the same manner asthe example in FIG. 3B, the display panel 211 of the display unit 200performs the same display as the display panel 121 of the mobiletelephone terminal apparatus 100.

In the following description, as illustrated in FIG. 3B, an example ofthe case of connecting by the transmission cable 300 will beillustrated, but, as illustrated in FIG. 4, the individual cases canalso be applied in the case of wireless connections.

In this regard, in the examples in FIG. 3 and FIG. 4, a description inwhich the display panel 121 of the mobile telephone terminal apparatus100 performs the same display as the display panel 211 of the displayunit 200 means that the images have the same contents (information), anddoes not means that video data corresponding to the display imagescompletely match. That is to say, the individual display panels 121 and211 might be different in the number of display pixels, display framecycle, etc, Here, a description of same images in this specificationdoes not means a complete match of video data, such as in the number ofpixels, etc., but means that a user who has viewed the display imagescan recognize the images having the same contents (information).

[1-3. Display Processing when Terminal Apparatus has Moved]

Next, as illustrated in FIG. 3B, a description will be given of anexample of display setting processing by the individual display panels121 and 211 the case of connecting the mobile telephone terminalapparatus 100 and the display unit 200 by the transmission cable 300.

A flowchart in FIG. 5 is a diagram illustrating processing performed bythe control section 110. First, the control section 110 determineswhether or not in a state in which the display unit 200 is connected bythe terminal section 170 (step S11). Here, if determined that thedisplay unit 200 is not connected, the processing waits until aconnection is detected.

And in step S11, when determined that the mobile telephone terminalapparatus 100 becomes a state of being connected to the display unit200, an image display by the display panel 121 of the mobile telephoneterminal apparatus 100 is fixed to a laterally-long display (step S12).That is to say, the image display is fixed to a laterally-long imagedisplay with the short side L2 of the display panel 121 being disposedin the vertical direction, and the long side L1 being disposed in thehorizontal direction.

And the terminal section 170 starts outputting video data under thecontrol of the control section 110 (step S13). By the output of thisvideo data, the display panel 211 of the display unit 200 displays animage having the same contents as the image being displayed on thedisplay panel 121 of the mobile telephone terminal apparatus 100.

In this manner, the display unit 200 performs the same display as themobile telephone terminal apparatus 100 so that the display screen ofthe display unit 200 can be directly operated at the side of the mobiletelephone terminal apparatus 100 by touch panel operation on the displaypanel 121 of the mobile telephone terminal apparatus 100. Also, in astate in which the same display is performed in this manner, the displayis performed through a user interface of a screen normally displayed bythe mobile telephone terminal apparatus 100 so that the user is allowedto operate the display screen with the same operationality as the caseof touch operation on a single mobile telephone terminal apparatus 100.This brings about an advantage in that it is not necessary for the userto learn an operation procedure for a dedicated user-interface screen atthe time of connecting the display unit 200 and the mobile telephoneterminal apparatus 100 and performing operation on the display of thedisplay unit 200.

And after the terminal section 170 has started outputting video data,the control section 110 determines a detection signal of the motionsensor section 108. The control section 110 determines whether or notthe casing constituting the mobile telephone terminal apparatus 100 hasbeen changed from the laterally-long direction to thelongitudinally-long direction from the detection signal of the motionsensor section 108 (step S14). Here, if such a change from thelaterally-long direction to the longitudinally-long direction is notdetected, the control section 110 keeps the current image output state.

And in step S14, when the control section 110 has detected a change fromthe laterally-long direction to the longitudinally-long direction, theimage displayed on the display panel 121 of the mobile telephoneterminal apparatus 100 and the image displayed from the terminal section170 are individually optimized (step S15). Specifically, the controlsection 110 changes the image displayed on the display panel 121 of themobile telephone terminal apparatus 100 to the longitudinally-longimage. Accordingly, at this time, directions of characters and figuresin the image are changed by 90°. Also, the control section 110 optimizesthe image output from the terminal section 170 so as to be displayed onthe display panel 211 of the display unit 200. For this optimization,the status bar indicating the state of the mobile telephone terminalapparatus 100 is changed to non-display, an image having optimum displaycontents is produced from the size of the display panel 211 of thedisplay unit 200 and the display ability (the number of pixels, etc.).For the image having the optimum display contents, for example, when thesize of the display panel 211 of the display unit 200 is relativelylarge, characters and figures in the image are set to relativelysmall-sized characters, and the amount of information (for example, thenumber of characters) to be displayed is increased. Also, informationomitted in the image before change may be newly displayed. A specificimage display example in step S15 will be described later at the time ofdescribing FIG. 6.

After performing optimization processing of the two images in step S15,the control section 110 will not change the display direction of theimage by the detection signal of the motion sensor section 108.

And the control section 110 determines whether or not the user hasperformed reset operation of the current display mode (step S16). Thisreset operation is performed, for example, by one specific key of theoperation keys 140 being pressed. Alternatively, the control section 110may display a specific button for the reset operation in the imagedisplayed on the display panel 121, and a determination may be made byexistence or absence of a touch operation of the button.

If there is no reset operation of the current display mode by thisdetermination, the control section 110 keeps the display state in stepS15.

And in step S16, if determined that the user has performed resetoperation of the current display mode, the control section 110 optimizesthe image displayed on the display panel 121 of the mobile telephoneterminal apparatus 100 to be displayed on the display panel 121 in thelaterally-long direction (step S17). Specifically, for example,characters, figures, etc., that are displayed on the small-sized displaypanel 121 are disposed in such a size as recognizable by the user. Also,a status bar s disposed at an upper end of the image.

And at this time, the control section 110 causes the image to be outputfrom the terminal section 170 of the mobile telephone terminal apparatus100 to have the same contents as the image displayed on the displaypanel 121, and disposes a status bar at the upper end of the image. Inthis regard, a display state set in step S17 is the same as the displaystate set in step S13 at the time of starting image output.

After going to a state in step S17, the control section 110 returns tothe determination in step S14.

FIG. 6 is a diagram illustrating an example of a change in the displayimage in the case of processing in accordance with e flowchart in FIG.5.

FIG. 6A is a diagram illustrating an example of display states of thetwo apparatuses 100 and 200 when image output is started from theterminal section 170 in step S13 in FIG. 5. The display exampleillustrated in FIG. 6A is the same as the display example illustrated inFIG. 3B. That is to say, the status bar 801, the search-character inputplace 802, and the news display place 803, etc., which are displayed onthe display panel 121 of the mobile telephone terminal apparatus 100,are displayed on the display panel 211 of the display unit 200 withoutchange. In the example in FIG. 6A, the enlarged status bar 901, theenlarged search-character input place 902, and the enlarged news displayplace 903 are displayed on the display panel 211. In this regard, thedisplay states in step S17 are also in the sate illustrated in FIG. 6A.

In the display state illustrated in FIG. 6A, as illustrated by an arrowM1, when the mobile telephone terminal apparatus 100 is changed from thelaterally-long direction to the longitudinally-long direction, thedisplay state is changed to the state illustrated in FIG. 6B.

That is to say, as illustrated in FIG. 6B, the image displayed on thedisplay panel 121 of the mobile telephone terminal apparatus 100 becomesa longitudinally-long image. At this time, the display processingsection 120 creates the image in which the status bar 811, thesearch-character input place 812, and the news display place 813, etc.,are accommodated in the longitudinally-long screen.

And the image that is outputted by the terminal section 170 of themobile telephone terminal apparatus 100 and is displayed on the displaypanel 211 of the display unit 200 is optimized to be displayed on thedisplay panel 211 thereof. For example, the status bar indicating thestate of the mobile telephone terminal apparatus 100 is changed tonon-display, and a search-character input place 911 and a news displayplace 912 are set into relatively small-sized characters. Also, aweather-forecast display place 913 and a news-video display place 914are disposed in the image displayed on the display panel 211, andprocessing for increasing the amount of information is performed. Also,the control section 110 changes a display layout of each piece ofinformation such that a display form of each piece of the informationbecomes suitable.

In this manner, when an image outputted by the mobile telephone terminalapparatus 100 is displayed on the display unit 200, the display mode ischanged by the direction of the mobile telephone terminal apparatus 100so that it is possible to optimize the individual display panels 121 and211 with simple and favorable operation. That is to say, when the mobiletelephone terminal apparatus 100 and the display unit 200 are connected,an image displayed by the mobile telephone terminal apparatus 100compulsorily becomes a laterally-long image, and the display unit 200displays the image having the same contents as the image of the mobiletelephone terminal apparatus 100. Accordingly, at the time of starting aconnection, the two apparatuses 100 and 200 display the same image sothat it becomes an easy display form for the user to understand. In astate of performing the same display, the display is performed with auser interface of a screen normally displayed by the mobile telephoneterminal apparatus 100, and thus it is possible for the user to operatethe display screen with the same operationality as the case ofperforming touch operation on the single mobile telephone terminalapparatus 100, and thus favorable operation is allowed.

Besides, when the mobile telephone terminal apparatus 100 is moved fromthe laterally-long direction to the longitudinally-long direction, themobile telephone terminal apparatus 100 changes to thelongitudinally-long image display. Also, the image displayed on thedisplay panel 211 of the display unit 200 is optimized to match the sizeand the display ability of the display panel 211. For example, thestatus bar indicating the state of the mobile telephone terminalapparatus 100 is not displayed on the image displayed on the displaypanel 211 of the display unit 200, and thus the image displayed on thedisplay unit 200 becomes easy to view. Also, the character sizes and thedisplay amount of information are set to match the size and the displayability of the display panel 211, and thus the image displayed on thedisplay unit 200 becomes easy to view from this point.

And after the display state illustrated in FIG. 6B is set, unless thereis a user operation of resetting the display mode, the state will notreturn to the display state illustrated in FIG. 6A, and thus even if thedirection of the mobile telephone terminal apparatus 100 is changedtemporarily, switching the display states will not occur frequently.

2. Second Embodiment

[2-1. Display Processing when Terminal Apparatus has Moved]

Next, a description will be given of an example of a second embodimentwith reference to FIG. 7 to FIG. 13. In FIG. 7 to FIG. 13, samereference numerals are given to same parts as those in FIG. 1 to FIG. 6,described in the first embodiment before, and the detailed descriptionwill be omitted.

In the example in the second embodiment, when the mobile telephoneterminal apparatus 100 and the display unit 200 are connected, and thedirection of the mobile telephone terminal apparatus 100 is changed, thedisplay performed by the display panel 121 of the mobile telephoneterminal apparatus 100 is different from that of the first embodiment.The configurations illustrated in FIG. 1 and FIG. 2, which weredescribed in the first embodiment before, are applied to theconfigurations of the mobile telephone terminal apparatus 100 and thedisplay unit 200.

A flowchart in FIG. 7 is a diagram illustrating processing performed bythe control section 110 in the second embodiment. In the flowchart inFIG. 7, processing from step S21 to step S24 is the same as theprocessing from step S11 to step S14 in the flowchart in FIG. 5.

And when the control section 110 has detected a change from thelaterally-long direction to the longitudinally-long direction in stepS24, the image displayed on the display panel 121 of the mobiletelephone terminal apparatus 100 is changed to a control screen. Also,the image outputted from the terminal section 170 is optimized for thedisplay unit 200 (step S25).

That is to say, the control section 110 changes the image displayed onthe display panel 121 of the mobile telephone terminal apparatus 100 tothe image of the control screen for performing various operations bytouch operation. The status bar is also displayed on this controlscreen.

And the control section 110 optimizes the image outputted from theterminal section 170 so as to be displayed on the display panel 211 ofthe display unit 200. For this optimization, for example, the sameprocessing as that described in step S15 of the flowchart in FIG. 5 inthe first embodiment can be applied. Specifically, the status barindicating the state of the mobile telephone terminal apparatus 100 ischanged to non-display, and the image having the optimum displaycontents is displayed from the size and the display ability (the numberof pixels, etc.) of the display panel 211 of the display unit 200.

After that, the control section 110 determines whether or not the touchpanel section 130 of the mobile telephone terminal apparatus 100 hasdetected a touch operation (step S26). Here, if a touch operation hasnot been detected, the control section 110 waits until a touch operationis detected.

And when a touch operation is detected in step S26, the control section110 detects whether the touch operation is a touch operation on thebutton for closing the control screen or not (step S27). Here, if thecontrol section 110 determined that the touch operation is not a touchoperation on the button for closing the control screen, the controlsection 110 performs input processing on the basis of the touchoperation at that time (step S28). The input processing in step S28corresponds to a button on the control screen being displayed or a touchpad. After performing the input processing on the basis of the touchoperation, the control section 110 returns to the determination in stepS26.

And in step S28, when the touch operation for closing the control screenis detected, the control section 110 optimizes the image to be displayedon the display panel 121 of the mobile telephone terminal apparatus 100to an image in the laterally-long direction on the display panel 121(step S29). Specifically, for example, characters, figures, etc., to bedisplayed on the small-sized display panel 121 are changed into thesizes and the disposition that are substantially recognizable for theuser. Also, a status bar is disposed at the upper end of the image.

And at this time, the control section 110 changes the image outputtedfrom the terminal section 170 of the mobile telephone terminal apparatus100 to the image having the same contents as the image displayed on thedisplay panel 121, and the status bar is disposed at the upper end ofthe image. In this regard, the display state set in step S29 is the sameas the display state set in step S23 at the time of starting the imageoutput.

After setting the state in step S29, the control section 110 returns thedetermination processing in step S24.

FIGS. 8A and 8B are diagrams illustrating an example of changing adisplay image in the case of processing in accordance with the flowchartin FIG. 6.

FIG. 8A is a diagram illustrating an example of display states of thetwo apparatuses 100 and 200 at the time of starting an image output fromthe terminal section 170 in step S23 in FIG. 7. The display exampleillustrated in FIG. 8A is the same as the display example illustrated inFIG. 3B and FIG. 6A. That is to say, the status bar 801, thesearch-character input place 802, and the news display place 803, etc.,which are displayed on the display panel 121 of the mobile telephoneterminal apparatus 100, are displayed on the display panel 211 of thedisplay unit 200 without change. In this regard, the display state instep S29 is also the state illustrated in FIG. 8A.

In the display state illustrated in FIG. 8A, as illustrated by an arrowM1, when the mobile telephone terminal apparatus 100 is changed from thelaterally-long direction to the longitudinally-long direction, thedisplay state changes into the display state illustrated in FIG. 8B.

That is to say, as illustrated in FIG. 8B, the display panel 121 of themobile telephone terminal apparatus 100 is changed into the image of thecontrol screen. In the example in FIG. 8B, the entire control screen isdisposed in a longitudinally-long manner, and the upper end of thedisplay panel 121 displays the status bar 821. On the control screen,buttons 822, 823 and 824 that instruct various operations are displayedby being disposed in a line under the status bar 821. And an areaexcluding the upper part in which these buttons 822 to 824 are disposedbecomes an area of a touch pad 825. In this regard, among a plurality ofthe displayed buttons 822 to 824, one of the buttons 823 is assigned toa button for closing the control screen. Also, the other of the buttons824 is assigned to a button for changing the control screen to anotherdisplay mode.

The touch pad 825 is an area for moving a cursor in the screen inaccordance with touched movement, for example, by a finger, etc. That isto say, as illustrated in FIG. 8B, the control section 110 displays acursor 931, such as an arrow, in the image displayed on the displaypanel 211 of the display unit 200. And the control section 110 changes adisplay position of the cursor 931 by movement detected on the area ofthe touch pad 825.

And, as illustrated in FIG. 8B, the image outputted by the terminalsection 170 of the mobile telephone terminal apparatus 100, anddisplayed on the display panel 211 of the display unit 200 is optimizedto be displayed on the display panel 211. The optimization of the imagedisplayed in FIG. 8B is the same as the image displayed in FIG. 6B.However, the case of the example in FIG. 8B is different from theexample in FIG. 6B in the point that the above-described cursor 931 isdisplayed in the display panel 211. At the position of this cursor 931,a touch operation by the user is performed on the touch pad 825.

In this manner, when the image outputted by the mobile telephoneterminal apparatus 100 is displayed on the display unit 200, the controlscreen for performing various operations is displayed by the directionof the mobile telephone terminal apparatus 100, thereby making itpossible to improve operationality of the operation related to thescreen being displayed on the display unit 200. That is to say, when theuser only moves the mobile telephone terminal apparatus 100 from thelaterally-long direction to the longitudinally-long direction, thecontrol screen can be automatically displayed, and thus the controlscreen can be displayed easily. In particular, at the time of performingcursor move operation using the touch pad 825, it is not necessary forthe user to view the display on the display panel 121 on the mobiletelephone terminal apparatus 100, and thus the user is allowed tooperate favorably.

Also, after the control screen is displayed, unless there is a useroperation to close the display, the display state is not returned to thedisplay state illustrated in FIG. 8A, and thus even if the direction ofthe mobile telephone terminal apparatus 100 is temporarily changed,switching the display state will not occur frequently.

[2-2. Another Example of Control Screen]

The control screen illustrated in FIG. 8B is an example of the controlscreen, and another control screen may be displayed.

For example, as illustrated in FIG. 9A, in a state in which the displaypanel 121 of the mobile telephone terminal apparatus 100 displays thecontrol screen, it is assumed that the button 824 that changes thecontrol screen to another display mode is touched by the user's finger,etc.

At this time, as illustrated in FIG. 9B, on the display panel 121, aselection screen 826 of the display screen is displayed below the button824 as a pull-down menu. The user selects any one of the items displayedas the selection screen 826 by touch operation so that the display ischanged to the corresponding control screen.

A flowchart in FIG. 10 is a diagram illustrating an example of theselection processing at the time of selecting the control screen. First,the control section 110 determines whether there is a mode selectionoperation by the operation of the button 824 illustrated in FIG. 9 ornot (step S31). By this determination, if there is a mode selectionoperation, the control section 110 displays the selection screen 826illustrated in FIG. 9B. And the control section 110 determines whetheror not a mouse cursor mode is selected from the selection screen 826(step S32). Here, if the mouse cursor mode is selected, the controlsection 110 displays a control screen in the mouse cursor mode on thedisplay panel 121 (step S33). The control screen in the mouse cursormode is the control screen displayed on the display panel 121illustrated in FIG. 9B.

Also, in step S32, if determined that the selection is not the mousecursor mode, the control section 110 determines whether a 4-way mode wasselected or not (step S34). Here, if the 4-way navigation mode wasselected, the control section 110 displays a control screen in the 4-waynavigation mode on the display panel 121 (step S35).

Also, in step S34, if determined that the 4-way navigation mode was notselected, the control section 110 determines whether a game-pad mode hasbeen selected or not (step S36). Here, if the game-pad mode has beenselected, the control section 110 displays a game-pad mode controlscreen on the display panel 121 (step S37).

Also, in step S36, if determined that the game-pad mode has not beenselected, the control section 110 determines whether or not a keyboardmode has been selected (step S38). Here, if the keyboard mode has beenselected, the control section 110 determines whether the direction ofthe current mobile telephone terminal apparatus 100 is longitudinallylong or laterally long (step S39). Here, if determined that thedirection is longitudinally long, the control section 110 displays akeyboard for longitudinally long on the display panel 121 (step S40).Also, if determined that the direction is laterally long, the displaypanel 121 displays a keyboard for laterally long (step S41).

Further, in step S38, if determined the keyboard mode has not beendetermined, the control section 110 further determines whether or not inanother mode.

And after performing display in the individual modes in steps S33, S35,S37, S40, and S41, the control section 110 returns a determination ofwhether there is mode selection operation or not in step S31.

FIG. 11 is a diagram illustrating an example of a display screen in eachof the modes. FIG. 11A is a diagram illustrating the control screen inthe mouse cursor mode. The control screen in this mouse cursor mode isthe screen that has already been described in FIG. 8B. On this controlscreen, a position of the cursor 931, etc., displayed on the displaypanel 211 of the display unit 200 is controlled on the basis of thetouch operation.

FIG. 11B is an example illustrating the control screen in the 4-waynavigation mode. In this case, on the display panel 121, a mark 827corresponding to a cross-key is displayed substantially in the middle.Also, the buttons 822 to 824 are displayed on the display panel 121 inthe same manner as in the mouse cursor mode, And when an upper side ofthe mark 827 is touched, a selected position on the display panel 211 ofthe display unit 200 is changed to an upper side than a position beforethe touch operation. In the same manner, when a lower side, a left side,or a right side of the mark 827 is touched, a selected position on thedisplay panel 211 of the display unit 200 is changed to a lower side, aleft side, or a right side.

FIG. 11C is a diagram illustrating an example of a control screen in thegame-pad mode. In this case, the display panel 121 displays variousbuttons 833 to 837 simulating key disposition of a control unit for avideo game machine. The control screen of this game-pad mode is assumedto be a display mode in which the display panel 121 is used in thelaterally-long manner. Also, the display panel 121 displays a button831, which closes the control screen, and a button 832, which changesthe control screen to another display mode. In this regard, a status baris not displayed on the control screen in this game-pad mode.

The control screen in this game-pad mode is displayed on the displaypanel 121 so that the user can perform game operation by touch operationon the display panel 121 of the mobile telephone terminal apparatus 100while displaying the execution screen of the video game on the displaypanel 211 of the display 200.

In this regard, the control screen in the game-pad mode, illustrated inFIG. 11C, may be automatically displayed, for example, by detection of achange in the direction of the mobile telephone terminal apparatus 100after the connection to the display unit 200 when the control section110 of the mobile telephone terminal apparatus 100 executes the videogame.

FIG. 12 is a diagram illustrating an example of still another controlscreen.

The control screen illustrated in FIG. 12 is a control screen forplaying back music. For example, while the control section 110 of themobile telephone terminal apparatus 100 is starting the music playbackprogram, when the display unit 200 is connected, and a change in thedirection of the mobile telephone terminal apparatus 100 is detected,the control section 110 displays the control screen for playing backmusic, illustrated in FIG. 12.

In the control screen for playing back music, illustrated in FIG. 12,the display panel 121 displays a status bar 841 at an upper end, and abutton 842 that instructs playback and forwarding and a button 843 thatinstructs various music selection lists are displayed in an upper-halfarea. Also, the display panel 121 displays a button 844 closing thecontrol screen, and a button 845 changing the control screen to anotherdisplay mode are displayed. Further, the display panel 121 displays amark 827 corresponding to a cross-key in a lower-half area. Byperforming touch operation on a surrounding area of the mark 827,forwarding, or volume adjustment, etc., is performed.

[2-3. Example of Keyboard Screen]

FIG. 13 is a display example when the keyboard mode is selected in stepS38 in the flowchart in FIG. 10.

In the keyboard mode, there are a case in which the display panel 121displays a longitudinally-long keyboard (FIG. 13A) and a case in whichthe display panel 121 displays a laterally-long keyboard (FIG. 13B).

In the case of displaying the longitudinally-long keyboard, asillustrated in FIG. 13A, the display panel 121 displays a status bar 851at an upper end, and displays a keyboard 852 corresponding to charactersand numerals, such as alphabets, etc., in a longitudinally-long manner.Also, an input-candidate-character display area 853 and aninput-determined-character display area 854 are displayed. Andcharacters displayed in the input-determined-character display area 854are displayed in a character input place 921, which is displayed on thedisplay panel 211 of the display unit 200.

In the case of displaying the laterally-long keyboard, as illustrated inFIG. 13B, the display panel 121 displays a status bar 861 at an upperend, and displays a keyboard 862 corresponding to characters andnumerals, such as alphabets, etc., in a laterally-long manner. Also, aninput-candidate-character display area 863 and aninput-determined-character display area 864 are displayed. And thecharacters displayed in the input-determined-character display area 864are displayed in the character input place 921, which is displayed onthe display panel 211 of the display unit 200.

In this regard, for example, when the character input place 921displayed on the display panel 211 of the display unit 200 is selectedby a cursor (for example, the cursor 931 in FIG. 11A), etc., thesekeyboards may be automatically displayed under the control of thecontrol section 110.

<3. Variations>

In this regard, each of the display examples of the screens illustratedin the individual figures is one example, and may be displayed inanother display manner. Also, in the example illustrated in FIG. 8B,when the display panel 121 of the mobile telephone terminal apparatus100 displays the control screen, the display on the display panel 211 ofthe display unit 200 is optimized for the display unit 200. On the otherhand, when the display panel 121 of the mobile telephone terminalapparatus 100 displays the control screen, the image displayed by thedisplay panel 211 of the display unit 200 may continue the precedingdisplay state illustrated in FIG. 8A. Alternatively, only the status bar901 may be deleted.

Also, in the above-described embodiments, descriptions have been givenof the case of connecting the mobile telephone terminal apparatus 100,which is formed as a smart phone, and the display unit 200, which isformed as a television receiver. On the other hand, the presentdisclosure may be applied to the case of connecting the other terminalapparatus and a display unit.

Further, as illustrated in FIG. 4, in the case of connecting theterminal apparatus and the display unit, in place of connecting by awired transmission cable, wireless transmission may be used, and thesame display processing may be performed by a change in the direction ofthe terminal apparatus, which becomes a transmission source of the imagethrough wireless transmission.

Also, a program (software) performing display control processing, whichwas described by flowcharts in FIG. 5 and FIG. 7, may be created, andthe program may be stored in a recording medium. By providing theprogram stored in the recording medium, the terminal apparatus, in whichthe program has been installed, becomes a terminal apparatus thatperforms the processing according to the present disclosure.

Also, the configurations and processing described in the claims of thepresent disclosure are not limited to the examples of theabove-described embodiments. It will be understood as a matter of courseby those skilled in the art that various alterations, combinations, andthe other embodiments may arise depending on design or the otherelements as long as they are within the scope of the claims or theequivalents thereof.

In this regard, the present disclosure can be configured as follows.

(1) An information processing apparatus, including: a display disposedon a casing; circuitry configured to process an image displayed on thedisplay; and an interface configured to externally output the imagedisplayed on the display; and a motion sensor configured to detect anorientation of the casing, wherein the circuitry is configured to detecta predetermined change in orientation of the casing based on an outputof the motion sensor, and generate different images as the imagedisplayed on the display and the image output by the interface as aresult of the detected predetermined change of orientation of thecasing.

(2) The information processing apparatus of (1), wherein the displayincludes a quadrilateral display screen having one of sides as a longside and the other of the sides as a short side.

(3) The information processing apparatus of (2), wherein the circuitryis configured to: detect a change in orientation of the long side of thedisplay from a substantially horizontal state to a substantiallyvertical state based on the output of the motion sensor; and change theimage displayed on the display and the image output by the interfacefrom images having same information to images having differentinformation.

(4) The information processing apparatus of any of (1) to (3), furtherincluding: a touch panel disposed on or integrally formed with thedisplay.

(5) The information processing apparatus of (4), wherein the circuitryis configured to generate different images as the image displayed on thedisplay and the image output by the interface by changing the imagedisplayed on the display to a control image for operating on the touchpanel.

(6) The information processing apparatus of (5), wherein the circuitryis configured to: detect a predetermined touch input received at thetouch panel based on an output of the touch panel; control the displayto change the image displayed on the display to an image of a keyboard;and detect an input to a key of the displayed image of the keyboardbased on an output of the touch panel.

(7) The information processing apparatus of (6), wherein the circuitryis configured to set a display direction of the keyboard based on anorientation of the housing detected based on the output of the motionsensor.

(8) The information processing apparatus of any of (5) to (7), whereinthe circuitry is configured to: detect a touch input requesting to closethe control image based on an output of the touch panel; and control theimage displayed on the display to be a same image as the image output bythe interface based on a result of the detection of the touch inputrequesting to close the control image.

(9) The information processing apparatus of any of (1) to (8), whereinthe circuitry is configured to generate different images as the imagedisplayed on the display and the image output by the interface bychanging the image output by the interface to an image suitable to bedisplayed on a display larger in size than the display panel disposed onthe casing.

(10) The information processing apparatus of any of (1) to (9), whereinthe circuitry is configured to generate different images as the imagedisplayed on the display and the image output by the interface bycontrolling the display to display a status indicating a state of theinformation processing apparatus on the image displayed on the displaydisposed on the casing, and not to include the status on the imageoutput by the interface.

(11) A non-transitory computer-readable medium includingcomputer-program instructions, which when executed by an informationprocessing apparatus, causes the information processing apparatus to:control a display disposed on a casing of the information processingapparatus to display an image; output, by a communication interface, themage displayed on the display; detect an orientation of the casing; andgenerate different images as the image displayed on the display and theimage output by the communication interface when a predetermined changeof orientation of the casing is detected.

(12) A method performed by an information processing apparatus, themethod comprising: controlling a display disposed on a casing of theinformation processing apparatus to display an image; outputting, by acommunication interface of the information processing apparatus, theimage displayed on the display; detecting an orientation of the casing;and generating different images as the image displayed on the displayand the image output by the communication interface when a predeterminedchange of orientation of the casing is detected.

The invention claimed is:
 1. An information processing apparatus,comprising: a display disposed on a casing; a touch panel disposed on orintegrally formed with the display; circuitry configured to process animage displayed on the display; control the display to display theimage; and externally output control information to control an externaldisplay to display a same image as the image displayed on the display;and a motion sensor configured to detect an orientation of the casing,wherein the circuitry is configured to detect a predetermined change inorientation of the casing based on an output of the motion sensor, andcontrol the display to display a different image as a result of apredetermined change of the detected orientation of the casing, thedifferent image including a control image for operating on the touchpanel, wherein the control image includes a control element thatinstructs the information processing apparatus to change a display modeof the different image; detect a touch input requesting to close thecontrol image based on an output of the touch panel; and control theimage displayed on the display to be a same image as the image that theexternal display is controlled to display based on a result of thedetection of the touch input requesting to close the control image. 2.The information processing apparatus of claim 1, wherein the controlelement instructs the information processing apparatus to change thedisplay mode of the different image from a first display mode of aplurality of display modes to a second display mode of the plurality ofdisplay modes in response to a touch operation on the displayed controlelement, the plurality of display modes including at least two of amouse cursor mode where a position of a cursor is controlled based on atouch operation, a 4-way mode where a cross-key is displayed to controlan area of the image displayed, a game-pad mode where a game-pad isdisplayed, and a keyboard mode where a keyboard is displayed.
 3. Theinformation processing apparatus of claim 1, wherein the displayincludes a quadrilateral display screen having one of sides as a longside and the other of the sides as a short side.
 4. The informationprocessing apparatus of claim 3, wherein the circuitry is configured to:detect a change in orientation of the long side of the display from asubstantially horizontal state to a substantially vertical state basedon the output of the motion sensor; and change the image displayed onthe display and the image that the external display is controlled todisplay from images having same information to images having differentinformation.
 5. The information processing apparatus of claim 1, whereinthe circuitry is configured to: detect a predetermined touch inputreceived at the touch panel based on an output of the touch panel;control the display to change the image displayed on the display to animage of a keyboard; and detect an input to a key of the displayed imageof the keyboard based on an output of the touch panel.
 6. Theinformation processing apparatus of claim 5, wherein the circuitry isconfigured to set a display direction of the keyboard based on anorientation of the housing detected based on the output of the motionsensor.
 7. The information processing apparatus of claim 1, wherein thecircuitry is configured to generate different images as the imagedisplayed on the display and the image that the external display iscontrolled to display by changing the image that the external display iscontrolled to display to an image suitable to be displayed on a displaylarger in size than the display panel disposed on the casing.
 8. Theinformation processing apparatus of claim 1, wherein the circuitry isconfigured to generate different images as the image displayed on thedisplay and the image that the external display is controlled to displayby controlling the display to display a status indicating a state of theinformation processing apparatus on the image displayed on the displaydisposed on the casing, and not to include the status on the image thatthe external display is controlled to display.
 9. The informationprocessing apparatus of claim 2, wherein the plurality of display modesinclude at least the mouse cursor mode.
 10. The information processingapparatus of claim 2, wherein the plurality of display modes include atleast the 4-way mode.
 11. The information processing apparatus of claim2, wherein the plurality of display modes include at least the mousecursor mode and the 4-way mode.
 12. A non-transitory computer-readablemedium including computer-program instructions, which when executed byan information processing apparatus, causes the information processingapparatus to: control a display disposed on a casing of the informationprocessing apparatus to display an image; externally output, controlinformation to control an external display to display a same image asthe image displayed on the display; detect, using a motion sensor, anorientation of the casing; detect a predetermined change in orientationof the casing based on an output of the motion sensor, and control thedisplay to display a different image as a result of a predeterminedchange of the detected orientation of the casing, the different imageincluding a control image for operating on a touch panel disposed on orintegrally formed with the display, wherein the control image includes acontrol element that instructs the information processing apparatus tochange a display mode of the different image; detect a touch inputrequesting to close the control image based on an output of the touchpanel; and control the image displayed on the display to be a same imageas the image that the external display is controlled to display based ona result of the detection of the touch input requesting to close thecontrol image.
 13. A method performed by an information processingapparatus, the method comprising: controlling a display disposed on acasing of the information processing apparatus to display an image;externally outputting, using circuitry, control information to controlan external display to display a same image as the image displayed onthe display; detecting, using a motion sensor, an orientation of thecasing; detecting a predetermined change in orientation of the casingbased on an output of the motion sensor, and control the display todisplay a different image as a result of a predetermined change of thedetected orientation of the casing, the different image including acontrol image for operating on a touch panel disposed on or integrallyformed with the display, wherein the control image includes a controlelement that instructs the information processing apparatus to change adisplay mode of the different image; detecting a touch input requestingto close the control image based on an output of the touch panel; andcontrolling the image displayed on the display to be a same image as theimage that the external display is controlled to display based on aresult of the detection of the touch input requesting to close thecontrol image.